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COMPARATIVE  DYNAMICS  (SENSITIVITY  ANALYSIS) 
IN  OPTIMAL  CONTROL  THEORY* 

Hajime  Oniki 


I .  Introduction 


Optimal  control  theory  was  developed  by  Pontryagin  and  his 
associates  [9]  as  a  renovation  of  the  classical  theory  of  calculus 
of  variations-  It  provides  a  convenient  method  for  analyzing  a 
wide  class  of  economic  problems  such  as  planning  the  optimal 
capital  accumulation  of  an  economy  and  investigating  the  process 
of  investment  by  a  firm  or  by  an  individual.  Although  many  ap¬ 
plications  of  Pontryagin' s  theory  to  economic  problems  have  been 
published,  only  a  few  of  them  have  paid  attention  to  the  problem 
of  comparative  dynamics  (sensitivity  analysis),  i.e.,  that  of 
analyzing  the  effect  of  a  parameter  on  the  optimum  solution.—^ 

In  planning  problems  comparative  dynamics  may  be  useful  for  in¬ 
vestigating  the  dependence  of  a  plan  on  exogenous  factors.  In 
dynamic  behavioral  models  it  could  serve  as  a  tool  for  deriving 
the  demand  or  the  supply  func cions  of  an  economic  agent  in  ques¬ 
tion  . 


The  present  paper  develops 
comparative  dynamics  in  optimal 
the  basic  idea,  let  us  consider 
the  function  f(x,0)  in  x,  where 
as  fixed  while  the  maximization 
do  is  to  obtain  the  first-order 


a  systematic  method  dealing  with 
control  problems.  To  facilitate 
a  simple  problem  of  maximizing 
0  is  a  parameter  to  be  regarded 
is  carried  out.  What  we  usually 
condition: 


f  (x,  0  )  =  0, 


(1) 


and  to  solve  this  for  x.  Assume  that  the  solution  x  thus  obtained 
is  a  unique  optimum.  The  dependence  of  this  optimum  on  the  parame¬ 
ter  0  may  be  studied  by  calculating  the  derivative  of  x  with 
respect  to  0  j 


(2) 


f  . x ' ( 0 )  +  f  .  =0,  or 
xx  x8 


*,(6»  “  - 


This  method  can  be  extended  to  constrained  maximum  problems.  In 
the  theory  of  household  behavior,  for  example,  the  solution  is 
known  in  such  terms  as  Slutzky  equations,  Hicksians,  etc.,  where 
the  role  of  0  is  played  by  commodity  price  or  income. 

It  is  noted  that  Pontryagin's  optimum  condition  for  a  control 

problem  (composed  of  the  maximum  principle,  auxiliary  differential 

equations,  and  transversality  conditions)  is  essentially  the  first- 

2/ 

order  condition?  in  this  sense  it  is  an  extension  of  (1) .—  What 
I  intend  to  do  in  this  paper  under  the  name  of  comparative  dynamics 
is  to  extend  (2)  to  optimal  control  problems.  Under  certain  as¬ 
sumptions  we  shall  provide  a  set  of  formulas  by  means  of  which 
the  derivatives  of  the  optimum  solution  of  a  control  problem  with 
respect  to  a  parameter  may  be  calculated. 

It  is  well  known  that  under  certain  conditions  a  solution  of 
a  system  of  differential  equations  is  differentiable  with  respect 
to  a  parameter  appearing  in  the  system  (the  theorem  of  variational 
differential  equations) Since  Pontryagin's  condition  contains 
differential  equations,  it  is  suggested  that  one  might  make  use 
of  this  theorem  for  comparative  dynamics.  However,  an  immediate 
application  is  difficult,  since  the  theorem  presupposes  that  the 


differential  equations  are  continuous  in  state  variables,  while 

those  appearing  in  Pontryagin's  condition  frequently  exhibit  dis- 
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continuities  m  state  variables  (e.g.,  bang-bang  controls).— 

To  resolve  this,  we  shall  extend  the  theorem  of  variational  equa¬ 
tions  to  the  discontinuous  case  (Section  III) .  Once  this  is  at¬ 
tained,  we  can  readily  derive  formulas  for  comparative  dynamics 
from  Pontryagin's  condition  (Section  IV). 

The  method  of  comparative  dynamics  to  be  presented  in  this 
paper  is  general  enough  to  allow  a  parameter  to  appear  almost 
anywhere  in  the  original  control  problem;  e.g.,  the  objective  func¬ 
tion  may  contain  it,  the  initial  state  may  be  a  function  of  it,  or 
the  constraint  on  the  control  may  be  affected  by  it  (or  any  com¬ 
bination  of  these) .  The  paper  deals  with  the  effect  of  a  parameter 
on  the  optimal  control,  on  the  state  variables,  and  on  the  objec¬ 
tive  function.  Both  cases  of  finite  and  infinite  horizons  are 
considered. 

The  following  section  (Section  II)  formulates  our  problem. 
Section  III  is  devoted  to  extending  the  theorem  of  variational 
differential  equations  to  the  case  where  discontinuities  arise. 

The  main  results  will  be  presented  in  Section  IV.  It  will  state 
a  set  of  conditions  sufficient  for  the  optimum  solution  to  be 
differentiable  with  respect  to  a  given  parameter,  together  with 
formulas  for  computing  the  derivative.  Section  V  deals  with  the 
effect  of  a  parameter  on  the  objective  function.  The  last  section 
(Section  VI)  is  devoted  to  an  example  in  which  the  method  of  com¬ 
parative  dynamics  is  applied  to  a  model  of  optimal  capital  accumu¬ 
lation  . 


II.  The  Problem 


We  shall  be  concerned  with  an  optimal  control  problem  with 

a  parameter.  It  is  of  fixed  time,  variable  end-points,  autonomous 
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differential  equations,  and  fixed  constraints  on  controls;--1 — ' 
the  objective  function 


(3) 


■f 


f°(x(t) , u { t ) ,8)dt. 


is  to  be  maximized  in  x{t)  and  u(t),  subject  to 


(4)  x ( t)  =  f (x(t ) ,u (t) ,9 ) , 

(5)  g  (u  (t)  ,0)  §  0  (tQ  S  t  3  t  )  , 


(6) 


0:L(x(t.),e)  =o  (i  =  o,i) , 


where  ( t Q ,  t ^ )  ( — <»  s  tQ  <  t.^  s  ■+<*>)  is  a  fixed  interval  of  time,  x  is 

an  n-vector  (the  state  variables) ,  u  is  an  m-vector  (the  controls) , 

0  is  a  number  (the  parameter) ,  and  the  functions  f  :  R  -*  R  , 

.  n+m+1  n  ,i  n+1  r.  ..  ,  .  m+1  k ,,  ^ 

f:  R  -  R  ,  0  :  R  -‘Ri(0gr^Sn),g:  R  -*  R  (k  *  0) 

are  all  assumed  continuously  differentiable  with  respect  to  the 

arguments,  being  a  j -dimensional  space.  Let  us  put 


v(t)  =  f  (x(t)  ,  u  ( t )  ,0)  (t0  5  t  3  t^). 


(7)  v  (0)  =  0, 

so  that 


(3a)  v  =  v ( t  x ) . 


If  the  functions  u(t,0),  x(t,9),  and  v(t,0)  maximize  (3a)  subject 
to  (4) -(7)  for  a  given  parameter  0,  they  are  called  optimum.  In 
addition,  we  call  such  u(t,0)  optimal  control. 


The  appearance  of  8  in  the  above  functions  reflects  the 
fact  that,  in  general,  an  optimum  depends  on  it.  Comparative 
dynamics  deals  with  how  a  change  in  0  affects  an  optimum.  First 
of  all,  it  is  easily  established  that  for  each  t  the  set  of  optimum 
solutions  u(t,0)  and  x(t,0)  is  upper  semicontinuous  in  0  (with 
respect  to  the  inclusion  relation) ,  since  everything  is  continuous 
in  8.  Furthermore,  the  objective  function 

(3b)  v  =  v ( t  ^ )  =  v(t1,0) 

is  continuous  in  8 .  In  the  present  paper,  we  shall  focus  our  at¬ 
tention  on  the  differentiability  of  an  optimum  solution  with  re¬ 
spect  to  0 ,  assuming  its  uniqueness . 

It  is  seen  that  without  losing  generality  the  differentiability 
of  an  optimum  solution  may  be  examined  with  the  assumption  0=0. 

For  simplicity,  when  0  is  set  equal  to  zero,  we  may  suppress  the 
number  0  for  0  in  the  argument  of  a  function.  Thus,  f(x,u)  = 
f(x,u,0),  x(t)  =  x(t,0),  etc. 

Next,  we  state  Pontryagin's  optimum  condition  for  the  control 
7  8/ 

problem.—1 —  First  of  all,  define  the  Hamiltonian 

(8)  H(p,x,u,0 )  s  f°(x,u,0)  +p*f(x,u,9), 

and  its  maximum  in  u  subject  to  (5) 

tQ]  M(p,x, 9 )  h  Max  H(p,x,u,0) 

'  g(u,8)£0 

where  p  is  an  n-vector  (the  auxiliary  variables)  and  the  dot  denotes 
the  inner  product.  If  u(t)  and  x(t)  is  an  optimum  for  a  problem 
in  which  0=0,  then  there  exists  a  nontrivial  function  p(t)  on 
(tQ,t^)  such  that 


-6- 


(the  maximum  principle) 

(10)  H(p(t),x(t)  ,u(t)  )  =  M(p  (t)  ,x  (t)  )  , 

(the  auxiliary  differential  equations) 

(11)  p(t)  =  -Hx(p(t) ,x(t) ,u(t))  (tQ  £  t  S  tL), 

( the  transversality  condi t  funs ) 

(12)  p(ti)  e  L1  s  L:’  (x(ti))  (i  =  0,1), 
provided  that 

(13)  rank (0^  (x (t^) )  =  r^  (i  =  0,1), 

where  H  ,  01  are,  respectively,  the  partial  derivatives  of  H, 

K  X 

01  with  respect  to  x?  H  will  be  treated  as  an  n-vector  and  01 

X  »  ^ 

as  an  (r^,n)  -matrix.  Further,  L  is  the  subspace  of  R  spanned 
by  the  row-vectors  of  0  (x  (t . ) ) . 

X  1 

The  optimum  solution  characterized  by  the  above  condition 
ranges  over  a  very  wide  variety.  In  order  to  isolate  a  class  of 
optimum  solutions  which  can  be  studied  by  means  of  comparative 
dynamics,  we  define  a  regular  optimum  solution  in  the  following  way: 
DEFINITION: 

(a)  A  pair  (p,x)  is  regular  for  8,  if  the  control  u  satisfying 
the  maximum  principle 

(14)  H (p, x, u, 9 )  =  M(p,x,9) 

is  unique  and  is  a  continuously  differentiable  function 

(15)  u  =  u (p,x, 0 ) 

in  a  neighborhood  of  (p,x,8). 

(b)  An  optimum  control  u(t,9)  is  regular  at  t  for  6,  if 
(p  (t ,  8 )  ,  x(t,0))  is  regular  for  0  and  u(t,8)  =  u(p(t,8), 
x(t,0 )  ,8  )  . 


(c)  An  optimum  control  u(t,8)  is  regular  on 
for  0,  if  the  optimum  control  is  regular  for  0  at  tQ,  at 
t^,  and  at  each  t  of  except  for  a  finite  number 

of  points,  say  s  (called  switching  time-points) 

(j=l,...,q;  q  s  0)  ,  where  t^  <  s^  <  <  t^. 

It  is  easily  seen  that  not  all  optimum  solutions  are  regular. 

In  control  problems  encountered  in  applications,  however,  optimum 
solutions  usually  turn  out  to  be  regular.  In  the  sequel,  we  shall 
be  concerned  only  with  regular  optimum  solutions. 

The  concept  of  regularity  defined  above  has  a  close  relation 
to  (in  fact,  is  originated  from)  the  method  of  phase-diagrams,  used 
commonly  in  applications  for  solving  control  problems.  The  follow¬ 
ing  is  a  typical  regular  optimum  for  a  problem  with  0=0  described 
in  terms  of  phase-diagrams:  The  whole  interval  *-s  divided 

into  (q+1)  subintervals  by  the  switching  time-points  s^,...,s  . 

We  consider  an  optimal  control  u(t)  which  is  regular  (hence  smooth) 
at  the  interior  of  any  subinterval.  It  may  be  discontinuous  at  a 
switching  time-point.  On  the  other  hand,  the  (p,x) -space  is 
divided  into  regions  of  regular  points,  each  of  which  is  an  open 
set  (from  (a)  of  the  definition  of  regularity) .  The  path  of  the 
optimum  solution  (p(t),  x(t))  starts  at  an  interior  point  of  a 
region  at  t=tQ,  crosses  its  boundary  at  t=s^f  stays  in  the  interior 
of  another  region  for  <  t  <  s^,  crosses  its  boundary  at  t=s^, 
and  so  on.  It  terminates  at  an  interior  point  of  some  region  at 
t=t^.  The  path  is  smooth  in  the  interior  of  any  region.  At  a 
boundary  point  it  is  continuous  but  may  not  be  smooth.  if  we 
characterize  the  boundary  of  regions  which  the  path  crosses  at 
t=s_.  by  the  equation  h"1  (p,x)  -  0,  then 

(16)  h^(p(s  ),  x  ( s  j ) )  =  0  (j=l,...g). 
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We  shall  call  (p(s,),  x(s^))  switching  point.  Figures  la  and  lb 
illustrate  a  regular  optimum  solution  for  a  case  of  n=m=l  and 
q=2 . 

There  are  several  reasons  that  an  optimum  control  "switches" 
at  a  time-point,  say  t  =  s.  This  might  arise  from  the  fact  that 
the  set  of  effective  constraints  of  (5)  is  changed  from  one  to 
another  at  t  =  s.  Also,  it  might  arise  from  the  fact  that  the 
control  satisfying  (14)  jumps  from  a  local  maximum  to  another 
local  maximum  at  t  ~  s.  We  shall  study  the  properties  of  the  op¬ 
timum  control  at  a  switching  time-point  more  in  detail  in  Section  IV 

We  are  now  able  to  state  our  problem.  First,  to  simplify 
the  notation,  let  us  introduce 

z  =  (p  x) , 

(17)  F (z  ,  9 )  2  (-Hx (z,u(z,0)  ,8)  f (x, u  (z ,  0  ) ,  0  ) ) 

where  z  is  a  (2n) -vector  and  F:  R2n+1  -  R2a  is  a  continuously 
differentiable  function  for  regular  z  =  (p,x).  It  may  be  discon¬ 
tinuous  at  a  point  satisfying  h^ (z)  =  0.  Then,  the  constraints 
(4)-(6),  the  optimum  condition  (10)~(12),  and  the  switchings  (16) 
for  a  problem  in  which  0=0  can  be  reduced  to: 

(the  original  and  the  auxiliary  differential  equations 
together  with  the  maximum  principle) 

(10)  z(t)  =  F  (z  (t )  ) 

for  regular  t  in  (tQ,t^)  (i.e.,  for  all  t  except  s^,...,s  ), 

(the  switchings) 

(19)  h-’(z(sj)  =  0  (j  =  l,...,q). 


(the  end  and  the  transversalitv  conditions) 


(20)  ^1(2(tj,))  =  0  (i~0, 1) , 

where  i|iL:  R2n+:L  pn  is  a  function  of  (z,9)  and  (20)  is  equivalent 
to  (5)  and  (12).  To  see  that  this  is  possible,  it  suffices  to 
observe  from  (13)  and  the  definition  of  that  (12)  is  equivalent 
to  (n-rj  linear  constraints  on  z(t^). 

Our  task  will  then  be  to  investigate  how  the  function  z(t)  £ 
z(t,0)  is  shifted  when  the  parameter  0  is  changed  near  0=0. 

In  Section  IV,  we  shall  obtain  a  set  of  conditions  sufficient  for 
z  (t , 0 )  to  be  differentiable  with  respect  to  0  at  0  =0  and  formulas 
to  compute  the  derivative. 

It  is  noted  that  the  condition  (18) -(20)  is  only  necessary 
for  optimum.  Hence  it  is  possible  that  z(t)  =  z(t,0)  satisfying 
(18) -(20)  is  an  optimum  but  z(t,0)  satisfying  equations  like  (18)- 
(20)  for  a  small  0  /  0  is  not  an  optimum.  if  this  is  the  case, 
the  derivative  of  z(t,0)  with  respect  to  0  at  0  =  0,  though  it 
exists  and  is  computable,  does  not  describe  the  shift  of  the  op¬ 
timum  solution.  Such  a  case  may  arise  in  applications,  even  if 
the  optimum  for  0  =  0  is  regular.  (If  the  optimum  solution  is 
not  unique  at  0  =  0,  then  usually  this  will  be  the  case. )  It 
seems  that  there  is  no  systematic  way  of  dealing  with  this  kind 

9/ 

of  complexity?  it  can  be  analyzed  case  by  case  only.-  Yet  it  is 
true  that  in  many  applications  the  function  z(t,0)  satisfying  (18)- 
(20)  remains  as  the  unique  optimum  for  all  0  near  0=0.  In  such 
an  "interior-maximum"  case,  our  method  will  bt  useful  directly  for 
comparative  dynamics. 
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III.  Variational  Differential  Equations 

In  this  section,  we  shall  state  two  lemmas  on  variational 
differential  equations.  The  first  is  well  known  in  the  theory  of 
ordinary  differential  equations.  The  second  is  an  extension  of 
the  first  to  the  case  where  the  equations  are  allowed  to  be  dis¬ 
continuous  in  state  variables.  The  notation  in  this  section  is 
independent  of  that  in  the  previous  and  the  following  sections. 

Consider  the  following  system  of  differential  equations  to¬ 
gether  with  an  initial  condition,  both  containing  a  parameter  3 : 

(21)  x  —  F (x,0  )  , 

(22)  x(t  (6)  )  -  5(0), 

where  x  and  £  are  vectors,  F  a  vector-valued  function,  t  denotes 

the  initial  time,  and  5  the  initial  point  of  the  state  variable  x. 

The  functions  F,  t,  ?  are  all  continuously  differentiable.  Further, 

F  ,  F  ,  r . ,  etc.,  are  (partial)  derivatives,  and  F(x,0)  5  F(x), 
x  0  9 

5  (0)  s  5,  etc.  It  is  assumed  that  a  fixed  interval  of  time  T  s 
<t  ,t  )  is  given  and  that 

(23)  t  <  t  (0  )  <  t.  . 

o  1 

LEMMA  1  (Peano) j  Suppose  that  a  solution  x(t)  of  (21)  and  (22) 
in  which  8=0  exists  on  the  entire  interval  T: 

(21a)  x  ( t )  =  F  (x  (t ) ) ,  (t  e  T), 

(22a)  x (t )  =  5 . 

Then,  there  exists  a  positive  number,  say  & ,  for  which  the 
following  is  true: 
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(i)  For  each  0 ( | 0 \  <  &),  a  unique  solution  x (t, 9 )  of  (21), 
(22)  exists  on  T; 

(ii)  For  each  0 ( | 0 |  <  $ )  and  each  t (t  s  T) ,  the  following 
expressions  exist  and  are  continuous  in  (t,8): 


(24) 


x(t,0) 


5x  (t ,  8  ) 
b  t 


xQ (t  ,0 ) 
x0 (t,e ) 


<3x  (t ,  9  ) 

as 

a2x (t , e )  _  a2x(t,e ) 

ata8  aeat 


(iii)  The  derivative  x  (t)  s  x  (t,0)  satisfies  the  system 

9  9 

of  variational  equations 

(2  5)  xQ  (t)  =  Fx  (x(t)  )xQ  (t)  +  F0  (x  (t ) )  #  on  T, 

and  the  initial  condition 

(26)  x0(t)  =  ?e  “  *(T)Te 

Next,  let  h(x,6)  be  a  scalar-valued  function.  We  shall  deal 
with  a  system  of  differential  equations  with  discontinuities  in 
the  state  variables  specified  in  the  following  way: 

(27)  x  =  F(x,0),  if  h(xf0)  £  0, 

G(x,8  )  ,  if  h(x,8  )  <  0, 

(28)  x  (t  (9  )  )  =  §  (6)  . 

where  F  and  G  are  vector-valued  functions.  We  assume  that  the  func¬ 
tions  F,  G,  h,  t,  and  §  are  all  continuously  differentiable  with 
respect  to  (x,0)  or  0 .  We  asume,  for  definiteness,  that 
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(29)  h(5  (0)  ,0)  -  h(?)  >  0. 

LEMMA  2:  Suppose  that  a  solution  x(t)  (t  c.  T)  of  (27)  and  (28) 
for  0=0  exists.  The  function  x(t)  satisfies: 

(30)  x(t)  is  continuous  on  T,  and 

there  exists  a  switching  time  s(tQ  <  s  <  t^)  such  that 
x(t)  =  P  (x(t)  )  . 

(31)  h(x(t))  >0,  if  tQ  ?  t  <  s, 

(32)  h  (x  (s )  )  *  0, 

X  (t)  '=  G (x (t)  )  , 

(33)  h(x(t))  <  0,  if  s  <  t  S  tjj 

(34)  x(r)  =  5. 

Suppose,  further,  that 

(35)  (x  (s)  )  *F  (x  (s  )  )  ^  0, 

h  (x  (s)  )  *G(x  (s)  )  /  0, 

X 

where  the  dot  denotes  the  inner  product. 

Then,  there  exists  a  positive  number,  say  0,  for  which  the 
following  is  true: 

(i)  For  each  0  ( J 8 |  <  §),  there  uniquely  exists  a  switching 

time  s(0)  and  a  solution  x(t,8)  of  (27),  (28)  on  T.  The  functions 

s  (0  )  ,  x(t,0)  satisfy: 

(36)  x(t.e)  =  F(x(t,9)  ,0)  , 

h  (x  ( t ,  6  )  ,  0  )  >0,  if  tQ  *  t  <  s  (0  )  ; 


(37) 


h  (x  (s  (8  )  ,  0  )  ,  0  )  =  0  ; 
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(38) 


X(t,0)  =  G(x(t,0)  ,0  )  , 


(39) 


h(x(t,0),0)  <  0,  if  s  (0  )  <  t  S  t^? 

x(T(0)  ,0)  =  5  (0) . 


(ii)  For  each  0  ( j  0  J  <  &)  and  each  t(t  e  Tr  t  /  3(8)),  the 
following  derivatives  exist  and  are  continuous: 

(40)  s  (0)  =  •—l6-'1 
0l  '  d0 

x(t,0)  s  , 

o  t 


x  (t  @ )  =  — X-L*1  /  Q ), 

e  “  00 

X 0  (t , 0 )  =  ^fslLiUL  =  l2x(trS) 
0  at00  303t 


satisfy: 


(iiD  The  ‘ivatives  xQ  <t)  s  x0(t,O)(t  jt  s)  and  sQ  a  Sq  (q) 


(41) 

(42) 

(43) 

(44) 

(45) 


*0^  Fx  (x  (t )  )xq  (t )  +  F  (x(t)),  if  t  s  t  <  s; 


XQ  (t)  =  §0  -  x(t  )t0  ? 


*9^  Gx  (x  (t )  )  x0  (t )  +  G0  (x  ( t )  )  ,  if  s  <  t  S  t^f 
xQ(s+0)  =x0(s-O)  -  s0.[x(s+O)  -  x  (s-0)  ]  ; 


se  =  " 


hx(x(s)  )  .x0  (s-0)  +  h0  (x  ( s )  ) 
hx(x(s) )  *x  (s-0) 


hx(x(s)  )  -x0  (s+0)  +  hg  (x(s)  ) 
h^  (x  (s) )  *x  (s+0) 
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(iv)  The  derivative 

dx  (s )  ,  dx (s (8 )  ,  8  ) 

"  d0  "  dB 


0 


exists  and  is  given  by 

(47)  '^d0~S^  =  -s0  +  x0  (s-°) 

=  x(s+0)*s  +  x  (s+0)  ^ 

0  O 


Figure  2  illustrates  LEMMft  2.  It  is  noted  that  the  formulas 

(41)  through  (45)  are  two  successive  initial-value  problems  of 

linear  differential  equations;  a  program  capable  to  solve  an 

initial-value  problem  of  linear  differential  equations  can  also 

solve  (41 ) - (45 ) .  For,  we  may  first  solve  (41)  for  Xg(t)  on  (tQ,s) 

given  the  initial  condition  (42).  From  this  we  may  compute  xQ (s-0) , 

and  hence  s  by  means  of  (45).  Then,  v/e  may  proceed  to  solve  (43) 

for  xQ(t)  on  (s.t.)  given  the  initial  condition  x.(s+0)  computed 
0  1  0 

from  (44).  (Note  that  the  original  solution  x(t)  is  regarded  as 
fixed,  during  the  time  we  are  solving  (41) -(45).) 

Equation  (47)  provides  a  formula  to  compute  the  shift  of  the 
switching  point  x(s(8),0);  the  first  term  of  the  right  side  ex¬ 
presses  its  shift  arising  from  the  change  in  the  switching  time- 
point  s(0)  and  the  second  that  arising  directly  from  the  change 
in  the  function  x(t,0). 


IV .  Comparative  Dynamics 

In  Section  II  we  formulated  Pontryagin's  condition  satisfied 
by  a  regular  optimum  solution  z(t)  of  a  control  problem  into  the 
system  ( 18 )  —  ( 20 ) .  This  system  is  a  two-point  boundary-value 
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problem  of  ordinary  differential  equations  possibly  with  discon¬ 
tinuities  in  the  state  variables.  In  the  present  section  we  shall 
make  use  of  LEMMA  2  of  the  previous  section  to  present  a  set  of 
conditions  sufficient  for  the  function  z(t)  a  z(t,0)  to  be  differ¬ 
entiable  with  respect  to  6  near  G  =  0  and  to  obtain  formulas  to 
compute  the  derivative: 


THEOREM  1.  Suppose  that  a  unique  (regular)  solution  z(t) (t^  5 
t  ^  t^)  of  (18) -(20)  exists.  The  function  F(z,8)  is  assumed  con¬ 
tinuously  differentiable  for  all  (z,6)  such  that  0  is  near  0  and 
z  is  regular  with  respect  to  0.  The  functions  h^(z,9)  and  tyX(z,Q) 
are  also  continuously  differentiable  in  neighborhoods  of  (z(s_,),0) 
and  (z(tj,0),  respectively.  Suppose  further  that  the  following 
conditions  are  satisfied  by  z(t): 


(48) 

(49)  J  A|  = 


h^(z(s  )  )  *F(z  (s  .±0)  )  /  0  (j=l,...,q) 

2  J  1 


0 

0 

A 

= 

*z 

,1 

.1  1 

A 

1  -y 

z  Jr\ 

t  0, 


where  A  is  a  (2n, 2n) -matrix,  A^  =  ^  and  A^  =  tl  ^ . 

z  z 


y  are  (n,2n)- 
P 


matrices,  'l'1  s  'i>"L(z  (t.  ) )  is  the  derivative  of  i|i1(z,0)  with  respect 

Z  Z  1 

to  z  at  (z(t.),0),  y1  a  y  (t..)  is  a  (2n, 2n) -matrix  to  be  defined 

1  P  T|  1 

later  by  (66),  and  Ja|  is  the  determinant  of  A. 

Then,  there  exists  a  positive  number,  say  &,  for  which  the 
following  is  true: 

(i)  For  each  0  ( J  9  J  <  @),  there  uniquely  exists  switching 
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time-points  s  {0 )  ( j-1, . . . #q)  and  a  unique  regular  solution  z(t,9) 
satisfying 

(50)  z  (t,  6  )  =  F  (z  (t ,  0  )  ,  0  )  for  all  t  t  s_,(0), 

(51)  hj  (z  (Sj  (0)  ,0)  ,0)  =0  (j=l . q), 

(52)  tX(z (t ± , 9 ) ,9)  =  0  (i=0, 1) . 


(ii)  The  derivatives 


(53) 

3  ,  =  S 

je  je 

(0) 

=  ae  sj <e)  e  _ 

0 

(54) 

z0 

(t)  =  z 

0(t‘ 

-  Z  (t 

ae  ' 

,6) 

0=0 

(t^s  .  )  , 

3 

(55) 

_d_ 

d0 

'  Z  (s_.  ) 

■"IS 

III 

z  (s_.  (e )  ,e ) 

9  : 

=  0 

exist 

and 

satisfy 

(56) 

Z0 

(t)  =  F 

(z(t))-z  (t)  + 

Z  g 

F 

0 

(z  (t)  ) 

(t^s_.  ) 

(57) 

Z0 

<V  = 

-A-1 

•  B, 

(58) 

20 

(s .+0) 

1 

-  z0 

(s .-0)  -  s  •  [z (s  +0) 

J  3°  3 

-  z  (Sj-0)  ]  , 

hj  (z(s.)  ) -z  (s  ±0)  +  hij  (z  (s  . )  ) 

(59)  a  =  -  — - 1- - 2_  3 - 2 -  D_ 

^  h3  (z  (s  . ) )  -z  (s  ,i0) 

z  g  j 

(60)  ~  z  (s.)  =  z(s,±0) *sj0  +  zQ (s,±0)  (j=l,...,q). 


where 


<■ 

0 

",0  0  o' 

(61)  B  3 

B 

— 

ilf  •  v  +  ii 

” z  ye 

1 

ii  i 

B 

0i  m 

ib  *y.  +  ilr„ 

(61) 
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is  a  (2n)  -vector,  ■  ■■  i|i yf  +  tli*  is  an  n-vector,  ^  i|if(z(t,)) 

Z  B  0  0  0  X 

is  the  derivative  of  ^  'L  ( z ,  0 )  with  respect  to  0  at  (z(t^),0)  and 

Vq  =  y  (t.)  is  a  (2n) -vector  to  be  defined  later  by  (66). 

U  B  X 

Some  comments  on  this  theorem  follow.  First,  the  assumption 

of  continuous  differentiability  of  F(z,8)  will  be  satisfied  if  the 

derivatives  f  ,  f  ,  f .  ,  f  ,f  ,  f  ,  f°,  f°,  f°  ,  f°  ,  and 

x  u  0  xx  xu  x0  x  u  0  xx  xu 

exist  and  are  continuous  (see  (17),  (8),  (15));  we  need  the 

second-order  derivatives  to  obtain  s.  and  z  (t).  This  resembles 

B  9 

the  case  of  simple  maximization  shown  in  (2). 

Second,  assumptions  similar  to  (48)  appeared  in  LEMMA  2  pre¬ 
viously  (see  (35)).  We  need  (48)  and  (49)  for  the  sake  of  regul¬ 
arity  (not  in  the  sense  defined  in  Section  II  but  in  the  general 
sense) .  If  (48)  does  not  hold,  then  it  is  possible  chat  the  number 
of  switching  time-points  (  =  q)  changes  when  0  varies  near  0  or 
even  that  the  optimum  solution  z(t,0)  is  no  more  regular  (in  the 
sense  defined  in  Section  II)  for  a  small  8.  If  (49)  is  not  satis¬ 
fied,  then  it  is  possible  that  z(t,0)  is  no  more  unique  for  a  small 

0  so  that  the  derivative  zQ  (t)  may  be  undefined.  We,  however,  know 
that  usually  these  singularities  do  not  arise  in  applications.  In 
simple  maximization  (2),  a  regularity  condition  (jf^J  ^  0)  was 
required . 

Third,  the  formulas  (56)  through  (59)  are  regarded  as  a  suc¬ 
cession  of  (q+1)  initial-value  problems  of  linear  differential 
equations.  Comments  like  those  immediately  after  LEMMA  2  may  be 
mentioned  here  on  (56)-(60). 

PROOF  OF  THEOREM  1: 

We  shall  prove  the  theorem  for  the  case  q  =  1  by  using 
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LEMMA  2.  A  proof  for  the  case  q  =  0  (no  switching)  may  be  obtained 
simply  by  replacing  LEMMA  2  in  the  proof  below  with  LEMMA  1  and 
eliminating  all  statements  concerning  switchings.  A  proof  for  the 
case  q  >  1  (multiple  switchings)  may  be  obtained  first  by  extend¬ 
ing  LEMMA  2  to  the  case  of  multiple  switchings  (this  is  easy;  all 
we  need  to  do  is  to  use  LEMMA  2  successively  q  times)  and  then  by 
applying  the  result  thus  obtained  to  the  theorem  in  the  same  way 
as  shown  below  for  the  case  q  =  1. 

Thus,  for  the  rest  of  the  proof  we  assume  that  q  =  1.  For 
simplicity  we  write  =  s,  s^G)  =»  s  (0 ) ,  h*-  =  h,  etc. 

We  now  proceed  to  prove  the  theorem  for  the  case  q  =  1. 

First  of  all,  choose  any  t  (tQ  =?  t  =■  t^  at  which  the  optimum  is 
regular.  Then,  from  LEMMA  2  and  the  assumptions  of  the  theorem 
((18),  (19),  (48),  and  others),  we  can  assert  that  there  exist 

functions  a(ri,0)  and  y(t,ri,8)  satisfying 

(62)  y(t,Ti,0)  =  F(y(t,ri,e)  ,6)  (tQ  *  t  s  t^  t  ^  o(ti,9)), 

(63)  y  ( T  ,  T]  ,  0  )  =  T|, 

(64)  h(y(a(n,9),ri,0),0)  =  0, 

where  y  is  a  (2n) -vector  (state  variables),  r|  a  (2n) -vector  repre¬ 
senting  the  initial  value  for  y  (parameters) ,  and  0  a  number  (a 
parameter) .  The  assertion  above  can  be  shown  by  applying  LEMMA  2 
(2n+l) -times  for  the  (2n)  components  of  r|  and  8,  each  being  succes¬ 
sively  substituted  for  the  parameter  0  of  LEMMV  2.  Furthermore, 
LEMMA  2  shows  that  the  derivatives 

a  s  a  ( z  (t)  ,0)  , 

r|  dr| 

°e  *  ae  a(z(T)>0)' 


(65) 
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(66)  y^(t)  s  ^  y(t,z(T),0) , 

y0  (t)  3  bB  ,0)  (t  ft  s ) 

exist  and  satisfy 

(67)  y^(t)  =  Pz(z(tJ-y  (t)  (t  ft  B) 

Vt)  -  J' 

hz  (z  (s)  )  -y  (s±0) 

11  h  (z  (s  )  )  *y  (s±0) 
z 

y  (s+0)  =  y  (s-0)  -  [y  (s+0)  -  y(s-0)]o  ? 

*  Tl  T| 

(68)  y0  (t)  =  Fz(z(t)  )  .y0  (t)  +  P0  (Z(t))  (t/s), 

ye  =  °' 

h  (Z(3)  )  -y  (S±0)  +  h.  (z(s)  ) 
a  =  - ~2 - 2 - 

h  (z  (s)  )  -y  (s±0) 
z 

y0(s+o)  =  yQ(s-0)  -  (y (s+0)  -y(s-0)]-a  , 


matrix. 


Let  us  next  turn  to  the  conditions  (20). 
we  shall  write  as 

*z  *  ♦z(z<ti,>*  5  *e  (SB<ti))' 

Yr\  ~  ^^i^'  y0  =  ye  (fci)  '  etc* 


For  simplicity. 


as 


(69) 
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Then,  by  (20),  (49),  and  the  implicit  function  theorem,  a  continu¬ 
ously  differentiable  (2n) -vector-valued  function  r)(0)  satisfying 

(70)  t1(y(ti,n(0),0),0)  =  0  (i=0,l) 

exists  for  0  sufficiently  small,  and  satisfies 

<7U  T!e  E  ne  (0)  =  -a"-1  •  B , 
where 

(72)  ’'e <°>  5  ^  I 

|  e  =  o. 

The  derivative  (71)  may  be  obtained  by  differentiating  (70)  with 
respect  to  0  and  then  setting  8  equal  to  0. 

Now  define 

(73)  s  (6  )  -  a  (r)  ( 0  ) ,  0 )  , 

z  (t,e )  s  y(t,n (9 )  ,e ) . 

Then,  substitution  of  (73)  into  (62),  (64),  and  (70)  yields  (50)- 

(52).  We  have  thus  shown  that  a  solution  of  (50) — (52)  exists  for 
0  sufficiently  small. 

Next  we  shall  show  that  this  solution  is  unique.  Let  s(0) 
and  z(t,0)  be  an  arbitrary  solution  of  (50)- (52).  Define  r|(6)  by 

(74)  n<0)  =  z  (  t  ,  6  )  . 

Then,  (73)  must  hold,  since  the  pair  s(0),  z(t,9)  satisfies  the 
system  (50),  (74),  (51),  and  the  pair  cr(r|(0),8),  y(t,n(0),0) 
satisfies  the  system  (62) -(64)  with  r\  replaced  by  r)  ( 0  )  #  and  these 
two  systems  are  identical.  (Note  that  the  solutions  of  these  system 
are  unique  by  LEMMA  2  and  the  assumption  (48)  of  the  theorem.) 

If  we  substitute  the  second  equation  of  (73)  into  (52),  then  we 
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know  that  the  function  ri(0)  is  determined  uniquely  by  the  implicit 
function  theorem  and  the  assumption  (49)  of  the  theorem.  We  then 
conclude  that  the  solution  s (0 )  and  z(t,8)  is  uniquely  determined 
by  (50) -(52).  This  completes  proving  the  first  part  of  the  theorem. 

Proving  the  second  part  is  straightforward.  Since  the  right 
sides  of  (73)  are  differentiable  with  respect  to  0  (t^s(0))  (see 

(65),  (66),  and  (71)),  so  are  the  left  sides.  Differentiation  of 

(73)  then  yields  (putting  0=0) 

(75)  se  =  Ve  +  °e  ' 

z  (t)  =  y  (t)riQ  +  y  (t)  (t^s), 

t)  T)  b  U 

so  that 

(76)  z0  (t)  =  y^(t)rie  +  yQ(t)  (t^s). 

If  we  multiply  (67)  by  r|.  ,  add  this  to  (68),  and  use  (75)  and  (76), 

O 

then  we  obtain  (56)  through  (59).  Equation  (60)  can  be  proved  in 
an  analogous  way.  (QED) 

We  have  thus  obtained  the  formulas  for  computing  the  deriva¬ 
tives  s  and  z  (t)  .  it  is  straightforward  (though  tedious)  to 

O  0 

write  down  the  equation  (56)  in  terms  of  the  original  notation 
0 

f(x,u,0),  f  (x,u,6),  and  u(p,x,8)  (see  (17),  (15),  and  (8)).  In 
applications,  however,  it  is  easier  to  differentiate  (50)  directly 
with  respect  to  0  and  to  put  0=0  than  to  refer  to  the  formula 
of  (56)  stated  in  terms  of  the  original  notation. 

In  the  foregoing  discussions  the  original  control  problem  was 
of  the  type  of  variable  end-points;  the  end  and  the  transversality 
conditions  were  expressed  by  (20).  In  the  following,  we  shall  con¬ 
sider  two  special  cases: 
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(a)  The  initial  point  of  the  state  variable  is  fixed  at  a 
point  determined  by  the  parameter,  and  the  end  point  is  left  free 

'll0  (2,0)  3  t°(p,x,e)  =  X  -0(G),  and  ^(z.G)  =  ^(p.x.G)  =  p.  The 
conditions  (20)  become 


(20a)  x(tQ,0)  -  0(6)  =  0, 

P  ( t x , 0 )  -  0. 

where  0  is  an  n-vector-valued  function  of  9,  which  is  smooth  near 
9=0.  Let  us  put 

(t^s) , 


(54a) 

(63a) 

(66a) 


20 (t)  =  (p *(t)  x*(t)) 


r\  =  (n,?)  ,  t  =  tQ, 


y  (t)  s 

■n 


Pn(t)  P§(t) 
Xn(t)  x?(t) 


y0  (t)  s  (p0  (t)x0  (t)  ) 


(trfs) 


We  then  obtain 


A  = 

‘W  p;(tl) 

„  fvv‘ 

,  E  = 

0  1 

-  0 

L  ’"e  * 

so  that  the  regularity  condition  (49)  and  the  initial  condition 
(57)  for  this  case  can  be  written  as 


(49a) 

K<vl 

/  0, 

(57a) 

VV  " 

-pn( 

*0<tO)  = 

*9  ' 

-1 


where  0Q  is  the  derivative  of  0(0)  at  0  = 


0. 
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(b)  The  initial  and  the  terminal  values  of  the  state  vari¬ 


ables  am  completely  determined  by  the  parameter:  i|i  (z,0)  ~ 
il,:L(p,x/0)  =  x  -  <2^ X  ( 8  )  ( i  =  0,1),  say.  For  this  cs.se,  we  obtain 


A  =  0 


x  (t  )  x  (t  ) 
n  1  f  1 


B  -  I-  0 


W  "  0e 


and  hence 


(49b)  I  (t^  /  0, 


(57b)  P0(to)  =-XTT(ti)  1*  (fcT  >0°  +  (t1  )  -0q), 


TT  1  ' 


V  l'-'e  6‘  l 


VV  "0e 


V.  Sensitivity  of  the  Objective  Function 

In  this  section,  we  shall  examine  the  effect  of  the  parameter 
on  the  maximized  value  of  the  objective  function.  To  do  this,  we 
compute  the  derivative  of  (3)  or  (3a)  with  respect  to  0  at  0  =  0: 


V‘i: 


a?  v(ti>6) 


0=0 


If  the  derivatives  x  (t)  and  p  (t)  have  already  been  obtained  by 

0  0 

means  of  the  comparative  dynamics  as  explained  in  the  previous  sec- 

tion  (for  simplicity,  we  write  x  (t),  pQ (t)  for  x  (t)  ,  pn(t),  re- 

spectively) ,  we  may  calculate  (77)  directly  by  differentiating  (3) 

(Note  that  p  (t),  x  (t),  and  u  (t)  exist  on  (t  ,t  )  except  at  a 
0  0  0  U  1 

finite  number  of  points.): 


-r 


(f°(t)x  (t)  +  f°(t)u  (t)  +  f  q  (t )  ]  dt , 

Xo  U  0  c 
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where  ff(t)  s  f  ^  (x  (t )  ,  u(t)), 
x  sc 

u0  (-t )  3  ux(p(t),x(t))xe{t)  +  up(p(t)  ,x(t)  )p0  (t)  + 

(see  (15)),  etc.  in  the  following,  we  shall  abbreviate  arguments 
of  a  function  as  done  above. 

It  is  possible  to  obtain,  from  Pontryagin's  condition,  further 
properties  of  the  derivative  v  .  In  order  to  do  this,  define 

(79)  w(t)  =  H  (t)u  (t)  +  H.(t)  (t?*s  ) 

U  0  0  J 

r 

W  (t)  =|  w(t  )dT. 


We  shall  prove 

THEOREM  2:  If  the  condition  assumed  for  THEOREM  1  is  satisfied, 
then 

v0(tl)  =p(tO)x0(tO)  “p(tl)x0(tl)  +  w(t  )m 

.  ,i 

Furthermore,  the  term  p(t.)xQ(t.)  vanishes,  if  the  function  0 

i0i 

in  the  end  condition  (6)  of  the  original  control  problem  is  inde¬ 
pendent  of  0:  01(x,9)  =  01(x),  say. 

PROOF:  Differentiation  of  (7)  with  respect  to  0  yields 

(81)  v  (t)  =  f°(t)x  (t)  +  f°(t)u  (t)  +  fp(t)  (t^s.). 

b  X  b  U  0  b  J 

In  view  of  (17) ,  we  write  down  the  second  half  of  (56): 

(82)  x0(t)  =f  (t)x  (t)  +  f  (t)u  (t)  +  ffi(t).  (t^s  ) 

0  X  b  U  b  0  J 

The  auxiliary  equation  (11)  is  (see  (8) ) 

(11a)  p(t)  =  -  [f°(t)  +p(t)fx(t)]  (t^sj., 
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Forming  t (81)  +  p(t)-(82)  +  (11a)  ■  xQ  (t ) ]  and  using  (8),  (79), 

O 

we  get 

(83)  “j~T  (v0  (t)  +  p(t)x0(t))  =  w(t)  (t^s  )  . 

We  then  obtain  (80)  by  integrating  (83)  over  (tQ,t^),  since 
vQ (tQ)  =  0  (see  (7) ) . 

Next,  assuming  that  01  is  independent  of  0,  we  write  down  (6): 
(6a)  01  (x  ( t^ ,  0  )  )  -  0 . 

Differentiate  (6a)  with  respect  to  0  and  set  0=0,  obtaining 

(84)  (x (t . ) )x  (t . )  =  0. 

X  19  1 

This  implies  that  the  vector  x  (t .  )  is  orthogonal  to  the  row  vectors 
i  0  2. 

of  0  (x(t.)).  In  view  of  (32),  we  conclude  that  p(t.)x  (t.)  =  0. 

XI  1  0  1 

(QED) 

Equation  (80)  states  that  v  is  the  sum  of  three  terms,  the 

u 

first  and  the  second  being  the  derivative  x  (t.)  multiplied  by  the 

0  i 

auxiliary  variable  p(t^)  and  the  third  W(t^)  .  Since  W(t^)  is  ob¬ 
tained  from  the  Hamiltonian  (see  (79)),  which  is  also  t)  i  product 
of  the  functions  f°,  f(  =  x(t))  with  p(t),  we  can  recognize  that 
a  role  of  the  auxiliary  variables  p(t)  is  to  relate  the  state  var¬ 
iables  to  the  objective  function. 

k 

Furthermore,  let  x  be  the  k-th  component  of  the  vecto  ■  x. 

If  we  assume  that 

(85)  xk(tQ)  =  6 

for  the  end  condition  (6)  for  i=0,  and  that  (85)  is  the  only  place 
that  the  parameter  9  appears  in  the  control  problem,  then  (80) 
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yields 

(86)  vQ  =  pk(tQ) / 

since  the  last  two  terms  of  the  right  side  of  (80)  vanish.  Thus, 
we  have  shown: 

COROLLARY:  if  the  condition  assumed  for  THEOREM  1  is  satisfied, 

then 

(87)  dj£--  =  Pk(tn)  (k=l . n), 

0*  (‘o’ 

where  the  derivative  takes  into  account  all  the  adjustments  needed 
to  keep  the  solution  optimal.  Similarly, 

(88)  — —  =  -  pk(t  )  (k=l,...,n). 

dxk(t1) 

The  property  (87),  (88)  is  well  known?  p(t)  is  interpreted  to 
be  the  marginal  contribution  of  the  state  variables  to  the  objec¬ 
tive  function.  It  is  not  true,  however,  that  this  property  holds 

12/ 

without  qualification. —  The  corollary  above  shows  a  sufficient 

condition  for  (87),  (88). 

VI .  An  Example  (comparative  Dynamics  in  a  Model  of  Optimal 
Capital  Accumulation) 

In  the  present  section,  we  shall  attempt  to  show  how  the  com¬ 
parative  dynamics  developed  in  the  previous  sections  can  be  used 

for  economic  analyses.  A  standard  model  of  optimal  capital  ac- 

13  / 

cumulation  developed  by  Cass  [3]  will  be  used  as  an  example. — 

For  short,  we  shall  follow  his  notation  and  avoid  repreating  the 
definition  of  variables. 

To  begin  with,  write  Pontryagin's  condition  for  the  model 
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r  14/ 

of  Cass: — 

(18c)  q  =  (6  -  f 1  (k)  )q, 
ft  =  f  (k)  -  c(q)  , 

(20c)  k(0)  =  k° ,  k(T)  =  kT, 

where  u' (c(q))  s  q.  por  simplicity,  it  is  assumed  that  X  =  0  and 
that  z  >  0  throughout  the  planning  period  (0,T)  (i.e.,  no  switching). 

We  shall  consider  the  discount  rate  6  as  the  parameter.  We 

then  write:  q  h  q(t,6),  k  s  k(t,6),  c  s  c(q(t,6))  a  c(t,6),  etc. 

In  view  of  (57b)  appearing  at  the  end  of  Section  IV,  we  know  that 

we  need  k  Q(T)  and  k&  (T)  ,  where  q(G)  a  q® .  To  do  this,  let  us 

q  0 
differentiate  (18c)  and  (20c)  with  respect  to  q  to  obtain 

Uel  =  f6~f '  -£"<I  1  *  f  <5  n  1 


q  Q(0)  =  1.  k  Q(0)  -  0 


The  sign  of  each  element  in  the  matrix  appearing  in  (67c)  is  deter- 

15  / 

mined  from  Cass's  assumption  as  follows: — 


To  investigate  the  path  of  q  ^(t)  and  k  Q(t),  we  construct  a  phase 

q  q 

diagram  (sec  Figure  3).  Each  arrow  in  the  phase  diagram  .indicates 
a  possible  direction  of  the  path.  Since  the  path  starts  at  a  point 


on  the  upper  half  of  the  vertical  axis,  it  is  clear  from  the 
diagram  that 

(89)  q  g(t)  >  0,  k  Q(t)  >  0  for  all  t. 

q  q 

Following  a  similar  method,  we  obtain 


q6  (0)  =  0,  k6  (0)  =  0. 


From  this  and  a  phase  diagram  (see  path  A  in  Figure  4) ,  we  conclude 
that 

(90)  q  (t)  >  0  ,  k  (t)  >  0  for  all  t. 

6  0 

Then,  (57b),  (89),  and  (90)  yield 

(57c)  q*^0)  =  -k6(T)/k  q(T)  <  0, 

q 

k*  (0)  =  0. 
o 

*  T 

In  addition,  since  k  (T,5)  =  k  , 

(91)  k*  (T)  =  0. 

0 

★ 

Let  us  finally  consider  variational  equations  for  q  (t)  and 
*  " 
k  , (t)  (which  is  a  special  case  of  (56)).  In  fact,  these  equations 
6  *  * 

are  obtained  b]>  substituting  q  and  k  into  (68c)  .  We  may  use 

6  *  6  * 

Figure  4  to  describe  the  path  of  q  (t) ,  k  (t).  In  view  of  the 

6  6 

end  conditions  (57c),  (91),  we  know  that  the  path  must  start  at  a 
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point  on  the  lower  half  of  the  vertical  axis,  and  must  terminate 
at  a  point  on  the  upper  half  of  it.  Hence,  it  stays  within  the 
second  and  the  third  quadrants.  It  is  seen  that  the  path  may 
cross  the  horizontal  axis  more  than  once,  but  never  the  vertical 
axis.  Path  B  in  Figure  4  is  a  typical  one. 

From  the  above  consideration,  we  can  conclude  that 

k  (t )  <  0 ,  for  all  t , 

0 

(92)  *  * 

c  ,  (t)  =  c 1 (q (t) } -q  ,{t)  >  0  for  small  t, 

6  0 

<  0  for  large  t, 

summarizing  the  effect  of  a  change  in  6  on  the  optimum  path. 
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APPKNDIX 


Proof  of  LEMMA  2 

1.  Let  x(t)  and  s  e  T  be  given  as  stated  in  the  first  part  of  the 
LEMMA.  We  may  extend  the  solution  x(t)  of  (31)  slightly  beyond 
the  switching  time  s; — '  i.e.,  there  exists  a  number  s  eT  and  a 
function  y(t)  defined  on  [0,s^]  such  that 

(Al)  s  <  <  1, 

(A2 )  y  (t )  -  x  ( t )  ,  on  [0,s] 

(A3)  y  (t)  =  F (y (t) ) ,  on  [O.s1]  , 

y(T)  =  ?  • 

Likewise,  for  the  solution  x(t)  of  (33),  there  exists  a  number 

2  2 

s  eT  and  a  function  z(t)  defined  on  the  interval  [s  ,1]  such  that 

(A4 )  0  <  s2  <  s, 

(A5)  z (t)  =  x (t) ,  on  (s, 1] , 

(A6)  z(t)  =  G  (z  (t)  )  ,  on  [s2,l], 

z (s)  =  x (s)  . 

2.  Consider  the  system  of  differential  equations 

(A7 )  y  =  F  (y ,  9  )  ,  on  [C^s1], 

and  the  initial  condition 

(AQ)  y(T  (B  )  J  =  ?  (0) . 

Then,  LEMMA  1  and  the  construction  of  the  solution  y(t)  by  (A3) 
immediately  yields  that,  for  a  sufficiently  small  9,  the  solution 
y(t,0)  of  (a7  )  ,  (A8)  exists  uniquely  on  the  interval  [O.s''']  and 

satisfies  (i) ,  (ii) ,  (iii)  of  LEMMA  1  with  x,  T  replaced  respectively 
by  y,  [  0 ,  s  L]  „ 
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3.  Let  us  next  consider  the  equation 
(A9)  h  (y  (o  ,0  )  ,0)  =0, 

where  a  is  an  unknown  variable. 

Since  we  have  [see  (32),  (A2)] 

(A10)  h  (y  (s ,  0 )  ,  0 )  s  h(y(s))  =  h(x(s))  =  0, 
and  [see  (35)] 

(All)  dh  (Y  la  t  °?..>  °.?.l  =  h  (x(s)  )  *  F  (x  ( s )  )  /  0 

da  I  x 

I  0=9 

it  follows  from  the  implicit  function  theorem  that,  for  a  suffi¬ 
ciently  small  0,  there  exists  a  function  s(8)  such  that 

(A12)  s (0)  =  s, 

(A13)  h(y(s(0)  ,0)  ,0)  s  0, 

(A 14 )  s (0)  is  continuously  differentiable. 

Differentiation  of  the  identity  (A13)  with  respect  to  0  at  0  =  0 
yields  [see  (35)] 

h  (y  (s ) )  -y  (s)+h  (y  (s) ) 

,  ,  _  ,  X  o  o 

(A15)  s  =  - - 

hx(y (s) ) *y(s) 

Furthermore,  we  have,  in  view  of  (Al) ,  (A4)  , 

(A  16)  <  s(0)  <  s\ 

for  a  sufficiently  small  0 . 

4,  We  shall  next  show  that,  for  a  sufficiently  small  0, 

(A17)  h(y(t,0),0)  >  0,  if  tQ  S  t  <  s(0). 

For,  suppose,  on  the  contrary,  that,  for  each  01  converging  to  0, 
there  exists  a  t1  such  that 
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(A18)  0  S  t1  <  s  (61)  , 


(A19) 


h  (y (t1,  0 1 ) ,0L)  s  0. 


Since  h  (y  (0 , 0) ,  0 )  >  0  [see  (31)],  we  have  h(y(0,8  )  ,  0  )  >  0  for 
a  sufficiently  small  01.  Since  h  (y  (t ,  0 1 )  ,  0 1 )  is  continuous  in  t, 
we  may  redefine  t1  so  that  inequality  (A18)  and 


(A20) 


h(y(t\  0  1 )  ,  0 1 )  =  0 


hold  for  all  i.  The  range  of  t1,  as  being  contained  in  T,  is 

bounded,  so  that  we  may  choose  a  converging  subsequence.  Let  us 

once  more  redefine  t1  to  be  such  a  converging  subsequence  and  de- 

* 

note  its  limit  by  t  .  Passing  to  the  limit  of  inequality  (A18) 

* 

[see  (A12)  ,  (A14)],  we  have  exactly  two  alternatives:  t  <  s, 

ic  "ic  ★ 

or  t  =  s.  But  if  t  <  s,  (A20)  implies  that  h(y(t  ,0),0)  = 

*  * 
h(x(t  ))  =0,  a  contradiction  to  (31).  Hence,  let  t  =  s.  In 

view  of  (A13),  we  have  h  (y  (s  (0  ,  0  ^ )  ,  0  "S  =  0.  Then,  (A20)  and  the 

mean  value  theorem  yield  that 

(A21)  h  (y  (s  (0  1)  ,  8  1)  ,  0 1)  -h(y(t\  G  X)  ,  0 1) 


_  dh.(.Y±q., 


do 


[  s  (0  1)  -  t1]  =  0, 


0=0 


where  t^  §  a1  S  s(G1).  Since  t1  ^  s  ( 9 1 )  Isee  (A18)],  (A21)  implies 

that 


(A22) 


dh  (y  (o ,  6  1 )  ,9  ) 


do 


=  h  (y(o1,01)  ,  0  1)  ■  F  (y  (o1, 01), 0  1)  =  0. 


o=o 


We  then  obtain,  taking  the  limit  of  (A22), 


(A23)  h  (y  (s,  0)  ,  0)  -F  (y  (s,  0)  ,  0)  =  h  (x  (s  )  ) -F  (x  (s  )  )  =  0, 

X  X 


which  contradicts  to  the  assumption  (35) .  Therefore,  inequality 
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(Al7 )  holds. 

5.  Let  us  next  consider  the  system  of  differential  equations 
(A24 )  z  =  0(2,0),  on  [s2,l]  , 

with  the  initial  condition 
(A25)  z  (s  (6  )  )  =  y  (s  (0  )  ,  0  )  . 

For  a  sufficiently  small  0,  y(s(9),0)  is  continuously  differenti¬ 
able  with  respect  to  9.  Furthermore,  z(t)  is  the  solution  of  (A24), 

2 

(A25)  on  the  interval  [s  ,1]  when  9=0  [see  (A6)] .  Therefore, 

all  the  assumptions  of  LEMMA  1  are  again  satisfied  when  x,  F, 

t{0),  5(0),  T  of  LEMMA  1  are  replaced  respectively  by  z ,  G,  s (0 ) , 

2 

y(s(9),0),  [s  ,1].  Then,  we  may  state  that,  for  a  sufficiently 

small  0,  the  solution  z(t,9)  of  (A24) ,  (A25)  exists  uniquely  on 

2 

the  interval  [s  ,1]  and  satisfies  (i) ,  (ii) ,  (iii)  of  LEMMA  1. 

In  particular,  (22a)  becomes 

(A26 )  z(s  (0)  ,9)  =  y  (s  (0  )  ,0)  . 

Also,  we  obtain,  in  view  of  (A25) ,  (26), 

(A27)  z  q  ( s )  =  [y0(s)  i-  y(s)s0]  -  z(s)s0. 

Furthermore,  it  can  be  shown,  as  was  done  in  4.,  that,  for 
a  sufficiently  small  8 , 

(A28 )  h(z(t,0),0)  <  0,  if  s  ( 6 )  <  t  3  . 

6.  Let  us  now  choose  a  sufficiently  small  §  for  which  all  the 
foregoing  constructions  are  valid.  Let  us  define  [see  (A26)] 

(A29)  X  (t ,  0  )  s  y(t,9),  (tQ  s  t  <  s  (0  )  )  , 

x  (s  (0  )  ,9)  a  y  (s  (0  )  ,  9  )  =  z(s(G)  ,9)  , 

x  (t ,  9  )  s  z(t,0),  (s(0)  <  t  3  t  ^ )  , 
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for  each  0  such  that  J  0  |  <  ij  .  Wc  then  conclude  that  the  number 
&  and  the  functions  s(0),  x(t,fi)  satisfy  (i)-(iv)  of  LEMMA  2. 
Note  that 


(A30)  x(s-O)  =  y  (s)  , 

xQ (s-0)  =  y0  (s) , 
x  (s+0)  =  z  (s )  , 

X0 (s+0)  =  zQ  (s  )  , 

and  that  (44)  and  (45)  can  be  derived  from  (A27),  (Al5)  ,  (A30)  , 

and  (43)  . 


Finally,  the  two  derivatives 


(A31)  SYi|10Uil 


dz  (s  (9  )  ,  6 


d0 


8=0 


)  =0 


=  y (s)  sQ  +  y0 (s) 


=  z  (s)  s  +  z0  (s)  , 


are  defined  and  coincide  [see  (A27)] .  Equations  (A29) ,  (A30) , 

then  lead  one  to  (46),  (47)  immediately.  (QED) 
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FOOTNOTES 


1/  See,  e.g.,  Koopmans  [6],  pp.  119-122,  a  graphical  approach  to 
comparative  dynamics  in  a  model  of  optimal  economic  growth. 

Cass  [3],  p.  844,  also  dealt  with  a  comparative  dynamics  in 
optimal  growth.  Jorgenson  [5],  pp.  147-151,  stated  a  method 
for  comparative  dynamics  in  investment  theory.  Oniki  [7]  and 
[8]  made  extensive  use  of  the  method  of  this  paper  for  problem.1 
of  optima]  growth  and  human  investment,  respectively. 

Outside  the  economics  literature,  Barriere  [2]  set  forth  in¬ 
vestigating  the  present  subject.  His  viewpoint,  however,  is 
narrower  than  ours:  first,  he  analyzed  the  effects  on  the  ob¬ 
jective  function  only,  while  ours  covers  those  on  the  optimum 
control  and  the  state  variables  as  well;  second,  he  did  not 
state  any  condition  sufficient  for  the  objective  function  to 
be  differentiable  with  respect  to  a  parameter,  while  ours  does 

2/  In  fact,  the  maximum  principle  contains  more  than  what  is  sup¬ 
plied  by  the  first-order  condition  in  calculus  of  variations. 

In  this  paper,  however,  we  do  not  use  the  implications  of 
the  maximum  principle  beyond  those  expressed  in  terms  of  first- 
order  derivatives. 

3/  LEMMA  1  of  Section  III. 

4/  Cass  [3]  used  this  theorem  for  comparative  dynamics  (his  foot¬ 
note  5) ,  In  his  case,  however,  the  optimal  control  is  continu¬ 
ous  in  state  variables;  the  difficulty  stated  in  the  text  does 
not  arise  there. 
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5/  Formally  speaking,  the  assumption  that  the  differential 

equations  are  autonomous  is  not  restrictive,  since  a  non- 

autonomous  system  can  always  be  converted  into  an  autonomous 

system  by  introducing  an  additional  state  variable:  x  .  =  t, 

n+1 

say. 

6/  For  simplicity  we  assume  that  the  constraints  on  controls 
are  fixed  so  that  g  in  (6)  is  independent  of  x.  The  main 
results  of  the  paper  will  continue  to  hold  if  g(u,9)  is  re¬ 
placed  by  g(x,u,8)  (with  appropriate  modifications,  some  of 
which  will  be  mentioned  later  in  footnotes). 

7/  See  Pontryagin  [9],  pp.  66-69,  189-191.  If  the  time-horizon 

is  infinite  so  that  t  =  +  «,  then  we  assume  that  lim  x(t  ) 

1  t  -  +~ 

exists.  (Similarly,  for  the  case  t^  =  -® . )  Furthermore,  an 
optimum  solution  of  the  infinite-horizon  problem  might  not 
satisfy  Pontryagin’s  condition  (see  Arrow  and  Kurz  [1],  p.  46). 
In  the  following,  we  exclude  such  cases  from  our  consideration. 
8/  If  the  function  g  depends  not  only  on  (u,0)  but  also  on  x, 
then  (9)  is  modified  accordingly,  and  (10)  is  replaced  by 
p(t)  =  -  [  H  (p(t)  ,x(t)  ,u(t)  +  X  (t)g  (x(t)  ,u  (t)  )]  ,  where  \(t) 

A  X 

is  the  Lagrangian  multipliers  associated  with  g  in  (9) .  With 
these  modifications,  the  discussions  through  Section  IV  will 
continue  to  hold. 

9/  The  situation  explained  in  the  text  may  arise  even  in  the 

simple  maximization  problem  discussed  in  Section  I.  Figures 

a  and  b  illustrate.  The  function  f(x,8)  has  two  local  maxima 
1  2 

near  9=0:  x  (9)  and  x  (9)  (Figure  a).  The  overall  maximum 

1  2 

x(9)  is  given  by  x  (9)  if  0  §  0  and  by  x  (0)  if  9  §  0  (Figure 

1  2 

b) .  One  needs  to  combine  the  derivatives  of  x  (8)  and  x  (9), 
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each  being  computable  as  in  (2) ,  in  order  to  describe  the 
shift  of  the  optimum  near  6=0. 

10/  For  proof,  see  Pontryagin  [10],  pp.  170-177,  194,  198,  or 
Hartman  [4],  pp.  93-94,  95-100. 

1 1/  For  proof,  see  the  Appendix. 

12/  For  a  counterexample,  see  Pontryagin  [9],  p.  73. 

13/  The  method  presented  in  this  section  was  once  introduced 
by  Oniki  [ 7] . 

14/  See  Cass  [3],  pp.  837-838. 

15/  See,  ibid.,  pp.  834-835. 

16/  See,  e.g.,  Pontryagin  [10],  pp.  163-166. 
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